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The probability distribution function for an out of equilibrium system may sometimes be approx- 
imated by a physically motivated "trial" distribution. A particularly interesting case is when a 
driven system (e.g., active matter) is approximated by a thermodynamic one. We show here that 
every set of trial distributions yields an inequality playing the role of a generalization of the second 
law. The better the approximation is, the more constraining the inequality becomes: this suggests a 
criterion for its accuracy, as well as an optimization procedure that may be implemented numerically 
and even experimentally. The fluctuation relation behind this inequality, -a natural and practical 
extension of the Hatano-Sasa theorem-, does not rely on the a priori knowledge of the stationary 
probability distribution. 
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I. INTRODUCTION 

A recurring strategy applied to out of equilibrium sys- 
tems is to represent the complex energy and dissipation 
sources by a bath with good equilibrium thermal proper- 
ties. Two examples are the Edwards "thermodynamic" 
approach to granular matter [T] and recent developments 
for active matter (see Refs. [SHI] for recent examples), in 
which the combination of rapid energy bursts and friction 
is mimicked by a thermal bath. The aim of such pursuits 
is not necessarily to make the problem more easily solv- 
able, but rather to cast it in a form that provides ther- 
modynamic intuition and constraints. In this paper we 
derive some simple relations that help make this mapping 
more systematic and controlled. The method is based on 
the use of inequalities of the form of the second law, as- 
sociated with each guess for the distribution function. 

In these last two decades there has been a develop- 
ment of a family of relations valid for out of equilibrium 
systems [5], including the fluctuation theorem in its var- 
ious forms ISHS] and the Jarzynski Ji]^ and Crooks [TT] 
relations. A later and extremely simple result is the 
Hatano-Sasa equality [T2] , which applies to systems that 
are continuously driven by time-dependent potentials in- 
ducing currents, so that even the stationary regimes are 
out of equilibrium. Their result is essentially a version 
of Jarzynski equality and the second principle, but with 
the energy replaced by the logarithm of the stationary 
distribution. 

In this paper we derive an extension of the Hatano-Sasa 
theorem for Markovian systems, which has the practical 
advantage that it does not rely on the a priori knowl- 
edge of the stationary probability distribution. Instead, 



arbitrary "trial" smooth distributions can be used, thus 
allowing one to treat systems whose stationary distri- 
bution is either (i) too difficult to calculate, as gener- 
ically occurs in out of equilibrium systems with many 
degrees of freedom, or (ii) unwieldy, as, for instance, in 
the deterministic limit, where the nonequilibrium steady- 
state distributions are nonzero only over a fractal sup- 
port. Our approach leads in particular to an inequality 
that can be used as a variational principle for improv- 
ing, in a controlled way, physically motivated approxima- 
tions to nonequilibrium steady-state distributions. The 
optimization procedure might be implemented numeri- 
cally or even experimentally. As an illustration, we nu- 
merically approximate the stationary distribution of a 
paradigmatic non-equilibrium driven system with many 
degrees of freedom, the simple symmetric exclusion pro- 
cess in one dimension. 

Just as in the case of the Hatano-Sasa equality [T^I20j . 
there is a "dual" (or adjoint) "backward" process that 
yields, when compared to the forward process of the orig- 
inal dynamics, a trajectory-dependent quantity playing 
the role of an entropy production that satisfies a form 
of the fluctuation theorem. For systems described by 
a Langevin dynamics, the dual backward process is ob- 
tained easily since it is given by a Langevin dynamics 
involving only additional a priori known external forces 
derived from the trial function itself. This remarkable 
property offers the possibility to explore numerically or 
even experimentally the interesting consequences of the 
associated detailed fluctuation relations, valid for sys- 
tems that spontaneously relax to nonequilibrium steady 
states. 

The organization of this paper is as follows. In Sec. |ll] 
we review the derivation of the Hatano-Sasa fluctuation 
theorem 1121 . After motivating a more general approach 
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we provide in Sec. Ill A a first derivation of the inte- 
gral version of our fluctuation relation along the same 
lines of the original Hatano-Sasa derivation. In Sec. |IIIB] 
we give a second, more general derivation, which yields 
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the detailed version of the theorem (containing the in- 
tegral version as a particular case), and in Sec. IIIC we 



discuss the physical interpretation of the dual dynamics 
behind it. In Sec. |III D| we discuss a family of inequal- 
ities that plays the role of the second law. In Sec. IV 
we propose an optimization procedure for approximating 
steady-state distributions. As an example, we apply it 
to the paradigmatic symmetric exclusion process in one 
dimension. In Sec. |V] we give a conclusion and perspec- 
tives. 



II. THE HATANO-SASA RELATION 

Consider a driven system with dynamic variables 
X with time-dependent external fields a(t) (e.g., 
shear rate, temperature gradient, etc.), with distribution 
p(x, i) evolving through a generator H{a): 



(1) 



Let us assume the dynamics admit, for every fixed value 
of the parameter a, a nonequilibrium steady state with 
distribution 

p,,(x;a) = e-*(^'") ; i?(a)p,,(x; a) = 0. (2) 
The Hatano-Sasa [12 result may be written 



(4) 



= 1, 

Pss(x;qi) 

which implies, by virtue of Jensen's inequality, 
90(x;a) 



da 



-da 



> 0. 



The average (•) is over all trajectories x(t) of duration r, 
starting with an initial configuration chosen with the dis- 
tribution pss(x; ai) with ai = a{0). We shall refer to ([s]) 
and Q as the Hatano-Sasa equality and inequality, re- 
spectively. In the particular case in which the stationary 
states Pss(x;q;) are Gibbs states we have 



Pss(x; a) 



(x;a)=/?[ii;(x,a)-F(a)] (5) 



and the Hatano-Sasa equality and inequality become the 
Jarzynski equality and the second law, respectively. 

The proof is extremely simple. We start by decompos- 
ing the evolution in a large number M of time steps and 
compute, in operator (bra-ket) formalism, the quantity 

( l^-^g(aM) PssjaAl) J^ss{az) ^-^H{a2) 



Pss(ai) 



^"^"'^\Pss{a,))^{-\pUaM))^m 



where e "^^"'^|pss(aj)) = \pss{ai+i))- We denote p{a) 
as the operator such that (x|p(q!)|x') — d{x — x') p{x;a) 



and \p{a)) as the state such that p(x; a) = (x|p(q;)). The 
state |— ) corresponds to the fiat distribution (x|— ) = 1; 
i.e., the left eigenvector of H{a) has zero eigenvalue. 

Now, using that the time step t/M is small, we can 
write 



Pss(x; gfc+i) 
Pss(x; ttfe) 



(7) 



Therefore ^ may be written as Eq. |3| , and the result is 



-Jdt 



O0(x;a) 



proven. The exponential of the term 

functional of the trajectory, is thus weighted in ([3|) with 
the probability of each dynamical trajectory x(i) such 
that x(0) is sampled from yOss(x, ai). 

In the Hatano-Sasa inequality Q, the equality holds in 
the quasistationary limit, when the probability distribu- 
tion may be assumed to be, at each time i, the stationary 
one pss (x; a) corresponding to the value of a at that time: 



/ 



9(^(x; a] 
da 



da 



dx da e 



da 



dx[pss{x; um) - Pssi^; ai)] = 0. 



(8) 



This result is the generalization of the entropy change 
S{a]^j) — S{ai) = (Jg dt x • V0), under reversible trans- 
formations, with S{a) = — J dxpss(x; a) lnpss(x; a) be- 
ing the generalized Shannon entropy |12j . 

III. A MORE GENERAL APPROACH 

The quantity (/)(x; a) — — Inpssix; a) plays a role sim- 
ilar to the one of the energy function in a system with 
detailed balance, but it may become intractable as soon 
as we consider a driven system. The first difficulty is that 
it is, in general, impossible to obtain analytically. This 
is aggravated by the fact that in order to use (|3| and Q , 
we need to know p^s also where it is exponentially small. 
Another more serious problem arises from the fact that 
the function (/'(x; a) may only be small in a limited do- 
main and very large everywhere else. An extreme form of 
this situation arises in the deterministic limit. Consider 
a noisy dynamics with a (Hoover [T5] ) thermostat: 



du 



thermostat 



forcing 



(9) 



where ri{t) is a Gaussian white noise of variance e. En- 
ergy is conserved provided ^{t) = ^^^2''^ ■ When there 
is forcing f ^ 0, the stationary distribution is not fiat. 
Indeed, in the limit of zero noise e — ^ 0, pss has, in fact, 
fractal support, and ^(x; a) is infinity almost everywhere 
on the energy surface. If we attempt to apply the Hatano- 
Sasa inequality for a small noise amplitude in a process 
with varying a, because the region on the energy shell 
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where (/)(x; a) is small is sparse and strongly dependent 
on a, almost all of the process takes place in regions in 
which 0(x; a) is large: the trajectories are very far from 
quasistationary, and the Hatano-Sasa inequality, though 
true, becomes useless. 

A similar situation arises when the potential is rapidly 
oscillating, as in vibrated granular matter, which we may 
think of as subjected to an oscillating gravity field. Here 
again, the system is always very far from the stationary 
situation corresponding to any instantaneous value of the 
field because it does not have the time to catch up with 
the oscillating stationary measure. And yet we still ob- 
serve that rapidly vibrated granular matter behaves in 
a manner that resembles motion in contact with a heat 
bath and would expect some form of second law to apply 
in that case. 

With the above motivations, we look for a more flexi- 
ble approach. Instead of working with the true stationary 
distributions pss(x;a), we choose an arbitrary family of 
smooth functions as reference states prei{x;a) and the 
corresponding 0ref(x;a) = — In p^ef (x; a) . In the fol- 
lowing we derive an extension of the Hatano-Sasa inte- 
gral and detailed fluctuation relations, using only these 
smooth functions. 



A. Integral fluctuation theorem 

In order to obtain a relation, we go through the same 
steps as in Sec. [Hj Starting from the initial distribution 
(/fref (x; ai ) , we compute, just as in ([6]), 

Pref(aM-l) Pref(ai) 
= (-IPrefKf)) - 1, (10) 

but with p{a) being the operator associated with the 
state evolved by one time step e^w-^*^"^ |p(q!)). We can 
thus write, for large M, 



which is the first main result of our paper. Defining 

y = I at a + / atip[x;a) (15) 



/9ref(x;a) 



(11) 



with 



(p(x;a) 



Pref(x;a) 



{ff(a)pref(x;a)}. (12) 



Here H(a) acts over the function pref(x;Q!), so that it 
is in fact (^(x;q;) — — (x|^-^^iJ(a)|pref («))■ We hence 
have 



pref (x; afc+l) 



e M dc 



(13) 



Pref (x; ak) 

and we obtain a new equality, valid for all sets (/>ref (x; a). 



Pref(x;Ql) 



1, (14) 



da 

it can be simply written as (e^-^) = 1. This integral 
fluctuation theorem is valid for any protocol a{t) and 
arbitrary times r, like the Hatano-Sasa equality, to which 
it reduces if the reference state is chosen as Pref (x; a) = 
Pss(x; a), but it holds for arbitrary smooth functions Pref 

m- 

As we shall see, this immediately implies an inequality 
(3^) > of the form of the second law. 



B. Detailed fluctuation theorem 



Just as in the case of the Hatano-Sasa relation, the 



result of Eq. ( 14 ) can be alternatively derived as a par- 



ticular case of a detailed fluctuation theorem. We will use 
here a procedure that generalizes the one used for obtain- 
ing the detailed fluctuation theorem associated with the 
Hatano-Sasa theorem [12 [Ml 123 EI] • 

We are looking for a time-reversed form of the dynam- 
ics. Let us start by rewriting ( 10 1 as 



Pref(Q:M-l) Pref(ai) 



(Pref (aM)k 



1 



Pref(aM-l) Prs±{ai) 
1 



^^^e-i.^(-)p,ef(ai)|- 



(Pref(aAf)lnfl/ 



e-^^("'=)pref(afe) 



_ Pref (a*;) 

We may now take the adjoint in order to reverse time: 



|nfc=A/-i 



1 



Pref ("fc) 
1 



e 



Pref (afe) 



t 



I Pref ("A/)) 



Pref (Ckfc) 



it 



IPref ("A/)) 



\nl 



e M 



IPref ("A/)). 



This is a time-reversed dynamics with generator: 
1 



Pref (a) 



{i/(a) + ^(a)}p,ef(«). (16) 



We shall see below that it corresponds, in fact, to a 
Langevin process with a modified force field [see Eq. 

In terms of the original and the adjoint dynamics, the 
evolution in time step r/Af is 



P(x'|x;a) EE (x'|e- 



P'^*(x'|x;a) = (x'|e-i7^°*|x) 



(17) 
(18) 



( [T6| tells us that , for each trajectory 
icmT wit 



The construction 

T = {xi,X2, ...,XMy with the initial condition chosen 
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with probability Pref (xi; ai), there is a time- reversed (R) 
trajectory, with the initial condition chosen with proba- 
bility Pref (xa/; om)) and their respective weights are 



A/-1 



'P[T;a] = -P(x„+i|x„;a„)pref(xi;ai), 



and 



A/-1 



We thus may define a quantity S[T;a] associated with 
each path, having an interpretation analogous to the en- 
tropy production, 



SfT; al = ln- 



[P'"^3 [T, a] 



In the large M limit, it becomes 



S[r; a] 



dt [(p(x; a) + (i^a^ref (x, a)] , 



(19) 



(20) 



It is clear from Eq. ( 19 1 that, in terms of ^, there is a 



detailed fluctuation theorem: 



{0[T]) 



adj 



(21) 



which is valid for an arbitrary functional 0[T] of the 
trajectory. The averages in (21) are performed with the 



real forward dynamics in the first term and with the time- 
reversed adjoint dynamics of Eq. ( 18 ) in the second term. 



Equation (21) is a very general result. It represents 
a broad family of fluctuation theorems with a trajectory 
dependent "entropy production" of the form of Eq. ( 20 1 , 
completely determined by the distributions pref (x; a). 

Clearly, choosing O = 1 in this equation we get the 
integral fluctuation relation of Eq. ( 14 ) . This detailed 



fluctuation theorem, which can be used to derive a variety 
of Crooks-like relations, is the second main result of our 
paper. 

C. Generalized dual (adjoint) dynamics 

In order to give a simple physical interpretation of the 
dual dynamics let us now assume that our system is gov- 
erned by a Langevin equation. 



Using Eq. (12), ip is given in this case by 

|2 



-V • f - TV 



f • V</>r 



(24) 



It is easy to check that, if e^'*"' is the stationary distri- 
bution, this expression vanishes. 
The expression for a path probability is 



(25) 



The last term in the argument of the integral comes 
from the Stratonovich discretization scheme. Then, us- 



ing equations (19) and (15) and time reversing in or- 
der to obtain the dynamical weight (that is, [Pe^^]^ — 
Q^adjjflj-R ^ 7""*), we have 

7'"*[x;a]- (26) 

ffVr lodt [(x+f(x;a))2-H4T(v(x,a)-<ia„<^„,(x,a)-H^)] ^ 
p-4T /J" [(x+f(x;a))2+4T<p(x,Q)+4Tx-V0„f(x,Q)+2TV-fl 

where in the last step we have dropped all reference to 
the boundary term, which is irrelevant for our present 
purposes. 

Is there a Langevin equation associated with the weight 
of Eq. (26)? In order to answer such a question, we 



follow a procedure analogous to the one used recently in 
Ref. [23 for the standard dual dynamic weight. Plugging 
expression ( 24 1 into Eq. ( 26 ) leads to a simple expression. 



■p''*[T;a] e^ar/o"'** [(x+f+2TV</-„f)"-2TV-[f+2TV0„f]] ^ 

where we can clearly identify the action of the following 
Langevin equation (in Stratonovich scheme): 



i = -f (x; a) - 2TV</.ref (x; a) + |(t). 



(27) 



The dual (adjoint) dynamics corresponds to a Langevin 
process with opposite force and an additional external 
potential (/>ref (x; a) which depends on the choice of Pref ■ 
All the results obtained so far reduce to the Hatano- 
Sasa results if we choose pref = Pss, m which case. 
If = 0, E becomes the Hatano-Sasa functional yns — 
dt d9Q0(x, a), and the extended dual dynamics be- 
comes the well-known (f ) standard dual dynamics [T^fSUl 
|3TJ |33| , which in terms of transition probabilities reads 
P'''(x|x'; a) = P(x'|x; a)^^^^^, as can easily be ob- 
tained from Eq. ([l8|. The Langevin equation for the 



i = f(x;a)+|(i). 



usual Hatano-Sasa dual dynamics (see for, instance, its 
derivation in Ref. [23]) coincides with Eq. (27), replacing 
(22) (/)ref by (j} 



- In Pss- 

Finally, it is worth noting that the extended dual dy- 
namics derived above has the advantage over the stan- 
dard dual dynamics that all the forces are known, so that 
it might be implemented in practice, numerically or even 
experimentally, by applying appropriate external fields. 
It should thus be possible to verify, numerically or exper- 
imentally, the detailed fluctuation theorem of Eq. ( 19 ) 
V • [[TV - f (x; a)] p] = ~H{a)p. (23) ^s well as other extended Crooks-like [IT] relations that 



with f(x;a) being an arbitrary force (conservative or 
nonconservative) , and being ^{t) a Gaussian uncorre- 
lated noise at temperature T, such that {^(t)) — and 
(C«(i)Cm(t')> = 2T(5(t - t')Snm- This is associated with 
the Fokker-Planck process: 

dp 
di 
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easily follow from Eq. (19 1 and concern systems with 
nonequilibrium steady states. It is with this practical mo- 
tivation that in the Appendix we derive the correspond- 
ing extended version of the three detailed fluctuation the- 
orems of Esposito and Van der Broeck [20j . It would also 
be interesting to explore further the implications of the 
extended dual dynamics, generalizing the results based 
on dual dynamics approaches in Refs. |12i, ,20. i31i i^ ). 



D. Generalizations of the second law 



As we did in Sec. ITT] we use the Jensen's inequality in 



Eq. ( 14 ) to obtain 



90ref(x ;o;) 
da 



da + dt ip{x: a) 



> 0. (28) 



/9rrf(x;Ql) 



It is worth emphasizing that the time evolution implied 
in the brackets is the real dynamics with initial states 
drawn from the distribution pref (x; ai ) . The relation is 
true for arbitrary Pref(x;a); a bad choice only makes 
the inequality less constraining. This is the third main 
result of our paper and the central formula we will ex- 
ploit for applications. The function (p(x; a) is a known, 
well-behaved extensive function of the dynamic variables, 
which vanishes if Pref (x; a) = yOss(x; a). For example, for 
a Langevin process (p2| it is given by Eq ( 24 ) . 



If at constant a the system is able to converge to a sta- 
tionary nonequilibrium regime, the inequality has to hold 
for large times such that the initial condition is forgotten. 
We thus get the stationary-state expectation: 

{^)ss^-(—H p,,i) >0 Vpref. (29) 
\ Pref / 

This inequality is already implicit in the work of Lebowitz 
and Bergmann [16] . If we define Wref = ^Hwj-^f with 



Wref (i = 0) = Pref , wc Can rewrite ( 29 ) as 



— [ dx pss In I — ^—-r\ 

dt J \Wy:el[t) 



dt 



Dkl{Pss II Wref{t)) 



t=0 

> (30) 



by virtue of the general result DKL{wi{t) \\ W2{t)) < 0, 
valid for all times t > with wi(t) and 'W2{t) being any 
two distributions evolving through H [IB] . The positively 
defined KuUback-Leibler distance Dkl used above is of- 
ten an actor in these problems; see [TTl [20H22] . 

For a purely Hamiltonian system DKL{wi{t) \\ 
W2it)) — independently of wi and W2- irreversibility in 
this case inescapably requires some form of coarse grain- 
ing, which this method does not provide. Instead, in the 
case of a Langevin process ( 23 1 , a short computation [24] 
gives 



where = — In pss ■ We have easy access to the left-hand 
side of the above equation numerically or even experi- 
mentally because we know c/jj-^f and the dynamics, but 
we do not have easy access to the right-hand side. 

Let us consider now a system that is perturbed period- 
ically, such as the granular system described above. As- 
sume further that the system reaches, after a long time, 
a periodic state. We then have 



9(/iref(x;a) 
da 



da 



(j) dt Lp{x;a)^ >0, (32) 



where the time integral is over one cycle in the regime in 
which the distribution becomes periodic in time. If we 
make the further simplification that pref is constant in 
time, we get 



((^),, =r(|V(0ref-0)P).. >o. 



(31) 



dtip{x:a)J>0, (33) 
where the dependence of on q comes from H{a). 

IV. A VARIATIONAL SCHEME 

The preceding section suggests an iterative variational 
procedure to optimize pref at fixed a: Propose a change 
to pref(x), compute the new tp = — Pref "^i^Pref (imme- 
diate), and run ((p(x))ss and accept the change if the re- 
sult is smaller. The resulting ip yields directly a second- 
law- like constraint, which is optimized. The optimiza- 
tion procedure we propose might be indeed implemented 
numerically or even experimentally to calculate, for in- 
stance, optimal effective interactions from steady-state 
measurements |25j . 

A. An application 

As an illustrative and nontrivial example, we consider 
the simple symmetric exclusion process (SSEP), a one- 
dimensional lattice of L sites that are either occupied 
by a single particle or empty. A configuration at time 
t is defined by the vector of occupation numbers n{t) = 
[ni(t), ni(t)] [ni{t)— 0,1]. Each particle in the bulk 
independently attempts to jump to an empty site to its 
right or to its left. At the left boundary each particle 
is injected at site 1 at rate a and removed from site 1 
at rate 7, whereas at the right boundary particles are 
injected at site L at rate 5 and removed from site L at 
rate f3. 

The choice of the rates a, 7, S and /? corresponds to the 
system being in contact with infinite left and right reser- 
voirs at densities po = a/{a + 7) and pi ~ S/{S + /3), 
respectively [26]. If po ~ pi = p, the system is in 
equilibrium, and the distribution is of product form: 
Pe,(n) = ntiP"'(l-p)'""' = e5:tiA.«7(l + e^)i, 
where p = ln[p/(l — p)] is the chemical potential. As 
soon as Po ^ pi , a current is established, and the problem 
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becomes nontrivial, with long-range correlations. The 
evolution of the probability p(n) of observing a configu- 
ration n is given by the master equation (n^ = + 1 



and n. 



dp{n) 



Uk-l) 



dt 

k=l 



+ S„^,oSnk+i.i)p{-,nk,nk+i, ...)] 



(34) 



+a^ni,ip(ni , ■•■) + "fSm,op{n{, ...) 
+W„^ap(---, nl) + (3Sr,^flp{...,n'l) 



Til ,1 



aS. 



"1,0 ■ 



'^'^nt,o)p(»^l, 



■ ,»^l)- 



The full measure on the microscopic configurations in 
the steady state Pssi'n) may be computed analytically 
through the so-called matrix method [2^. Here we 
propose an approximate form 0ref(n) = ^i^-j + 
Using the master equation, we evaluate 



Pref 



(n) 



at 




FIG. 1: (Color online) Optimized Jij for the SSEP model 
with open boundaries for po = pi (dotted red line) and for 
Po 7^ Pi (sohd blue Hne). The inset shows similar results for 
the optimized hi 



L-l 



hk-hk + i+J2j-ik,k + l 2{Jkj-Jk+l,j)nj 



k=l 



-I- A , p'^i'+l-hk-J2j^k,k + l'^(Ji'j-Jk + l,j)nj 

- {SnkA^rik+iM + 6nk,0^nk + i,l)] 

+ a(5„^,ie''i+^^vi2-A,", +^^^^^^gg-/H-E,^l2J^n, 
- (7<5nia + "'^"1,0 + /3(5„j,,l + '^(Jnj.^o)- (35) 

We compute the expectation value of this ip with the true 
SSEP dynamics and minimize with respect to the [hi, Jij] 
using a suitable algorithm 28J. Clearly, for pa = pi — p 
the system is in equilibrium, and we have for each site 
hi = h — — /i — ln[(l — p)/p] and Jij = [see Pe(j(n) 
above]. Unlike the equilibrium case, as soon as po 7^ pi, 
we obtain nonzero Jij corresponding to the long-range 
correlations characteristic of the stationary nonequilib- 
rium state; see Fig. [T] These correlations extend over 
macroscopic distances and reflect the intrinsic nonad- 
ditivity of nonequilibrium systems |26j . The optimized 
measure poptii^) = e^"*°p*("^ obtained with the [hi, Jij] 
that minimize the expectation value of p is not the ex- 
act solution of [27 , but we have checked the quality of 
the approximation by computing expectation values with 
this measure: this is most easily done with a Monte Carlo 
procedure with "energy" (l>opt{n). To do that one starts 
from a random initial configuration n{t = 0) and evolves 
it with a Metropolis algorithm where the probability to 
go from a configuration n to a configuration n' in a sin- 
gle jump is W(n — > n') = min ^ } , 1 (note that 

[PoptW J 

there are no reservoirs in this calculation). The configu- 
ration n' is the same as the configuration n, except for 
the randomly chosen node k, which changes its value to 



~ 1 — Uk- Wc then have 



Popt(n') 
Popt{n) 



= exp 



(2nfc-l) ihk + 2j2Jk 



kj 'h 



(36) 



Applying this dynamics we measured the steady-state 
density profile pi = (rii) shown in Fig. [2j and compared 
it with the analytical result obtained using the exact sta- 
tionary state measure Pss{n), which is (see 



Pa{L 



1 



^)+Pl(^-l + ^) 



L 



1 

a+~i 



-J- - 1 

13+6 ^ 



(37) 



We also compared with the result obtained assuming lo- 
cal equilibrium considering no reservoirs at the bound- 
aries and a spatially varying chemical potential, which 
is adjusted to maintain the same steady-state density 
profile (37). We then have that the local equilibrium 

''^•"7(1 ■ 

{rii 



measure is pi,£;(n) 



e '), where 



hi = -pi = ln[(l - {n^))/{n^)], with (n^) given by (|37|. 
Notice that this local equilibrium measure for po ^^Pi 
turns into the equilibrium measure by doing po = pi- In 
Fig. [2]we can see that there is perfect agreement with the 
exact analytical results for both po — pi and po pi and, 
in the latter case, for the optimized measure and for the 
local equilibrium measure. We also measured the two- 
point correlation function {ninj)c = {niUj) — {ni){nj), 
obtaining the results shown in Fig. [3j Using again the 
exact measure pss(n),one finds that the analytical pre- 
diction in the steady state for 1 < i < j < L is 

, , -iPo-Pl)\^+^-l){0^ + L-J) 



(— + 



1 

13+5 



+7 



1 

13+S 



L-2) 
(38) 
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FIG. 2: (Color online) Analytical and simulation results for 
the steady state density profile {ui). Red squares □ and 
orange crosses < correspond to the Monte Carlo procedure 
for densities po = 0.8, pi = 0.2 using the optimized trial 
Popt(n) and the local equilibrium measure p_L_E(n) respec- 
tivel y, w hereas blue diamonds are the analytical results, see 
Eq. ( 37 1 . Purple triangles A correspond to the Monte Carlo 
procedure for densities po = pi = 0.3 using the equilibrium 
measure peq(n), whereas black circles Q ''■re the analytical 
results. 



FIG. 3: (Color online) Analytical and simulation results for 
the two-point correlation function {ninj)c in the steady state. 
Red squares □ and orange crosses correspond to the Monte 
Carlo procedure for densities po = 0.8, pi — 0.2 using the opti- 
mized trial popt(n) and the local equilibrium measure pLB(n) 
respectively, whereas blue diamonds <) are the analytical re- 
sults, see Eq. (381. Purple triangles A correspond to the 
Monte Carlo procedure for densities po ~ Pi = 0.3 using the 
equilibrium measure peq{n), whereas black circles Q ^re the 
analytical results. 



For large L, introducing macroscopic coordinates i — Lx 
and j — Ly, this becomes, for x < y, {nLxnLy)c = 
—x{l — y){po — pi)"^ /L. As stated in [26], one may think 
that these weak, but long-range, correlations play no role 
in the macroscopic limit. However, they are responsible 
for a leading contribution in the variance of a macro- 
scopic quantity such as the number of particles. 
As expected, Fig. [3] shows how the Monte Carlo proce- 
dure fits exactly with the analytical results for po = pi 
{{ninj)c = 0) because we are using the equilibrium mea- 
sure in which no spatial correlations are present. In addi- 
tion, for Po 7^ pi we see how the results obtained with the 
optimized measure are much closer to the exact analyt- 
ical ones than those obtained with the local equilibrium 
assumption. This reflects the fact that with the opti- 
mized measure we are taking into account at least the 
two-site long-range correlations, which are not consid- 
ered in the local equilibrium case. This shows that the 
physically motivated optimized trial is very good, at least 
regarding one- and two-point static spatial correlation 
functions. In this sense the out of equilibrium state of 
the SSEP can be thus fairly approximated by simple and 
intuitive quantities such as the local effective fields and 
two-site long-range interactions. Although more difficult 
to guess, one might of course add other terms to the trial 
function to improve the present agreement, for instance, 
higher order interaction terms, but the difficulty of the 
numerical minimization problem increases very rapidly. 



V. CONCLUSION 

We have derived an exact relation for Markovian sys- 
tems that generalizes the Hatano-Sasa relation but does 
not rely on the a priori knowledge of the stationary prob- 
ability distribution, but rather on arbitrary trial func- 
tions for the stationary distribution. More generally, we 
have derived the detailed version of the fluctuation rela- 
tion by identifying a generalized form of dual (adjoint) 
dynamics, generating the backward process that yields 
a trajectory-dependent entropy production. For systems 
described by Langevin dynamics, we have showed that 
the dual dynamics is also governed by a simple Langevin 
dynamics, which may be expressed directly in terms of 
the trial functions. One may also obtain in this context 
a version of the three extended detailed fluctuation the- 
orems of Ref . [20] . 

Our approach leads to an infinite family of inequalities 
that generalize the second law, and suggests a variational 
principle for optimizing trial measures, in a quantitative 
and controlled way, to approximate nonequilibrium prob- 
ability distributions. The optimization procedure we pro- 
pose might be implemented numerically or even experi- 
mentally in order to infer nonequilibrium steady-state 
distributions in terms of intuitive physical quantities. To 
illustrate this, we have implemented this approximating 
scheme for the simple symmetric exclusion process in one 
dimension. 
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A particularly interesting case for applying this vari- 
ational approach is to active matter |29| . where it has 
been proposed recently to represent the complex energy 
exchanges in the system by a bath with equilibrium-like 
properties (Refs. [Ml])- Another interesting and some- 
what related system is that of current-driven vortices in 
superconductors with pinning. In this case the complex 
interplay of driving, quenched disorder and vortex-vortex 
interactions yields a variety of nonequilibrium dynamical 
regimes and transitions that may sometimes be success- 
fully described by effective temperatures (SO]- At any 
rate, the important property of these approximations is 
that there is a second law-type inequality associated with 
them. 
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Appendix A: Three extended detailed fluctuation 
theorems 



Using the dual dynamics of of Eq. (27 1, it is straight- 
forward to derive an extension for the three fluctuation 
theorems of Ref. [20] based, in our case, on smooth trial 
functions Pref rather than the true steady-state measure 

Pss- 

We define three trajectory dependent "entropy produc- 
tions" using time-reversal (i?) and the dual (adjoint) dy- 
namics: 



5[r,a] 


= \nV[T,a] 


-ln7'«[r,a]. 


(Al) 




= \nV[r,a] 


-ln[7"^*[r,a]]''. 


(A2) 


W[r, a] 


= \xiV[T,a] 


-ln7'"*[r, a]. 


(A3) 



so that by construction they satisfy the detailed fluctua- 
tion theorems, 



{0[T]e 



-S[TM\ - 



-y[T,a\ 



(0[71)"*J , (A5) 
(0[7-]e-^['^^"l) = (0[71)°*, (A6) 

where again O is an arbitrary functional of the trajectory. 



1 R 



For a system satisfying a Fokker-Planck process (23 1, 



it is easy to show using Eqs. (25), (26), and (15) that 



drS - /3f(x;a)-i|t=„ (A7) 
dry = [d5„0ref(x,Q;) -f (^(x;a)] |t=^, (A8) 

dryV = [/3f(x;Q:) • X - d^a^ref (x,a) + ((9(x;a)] 

(A9) 

with /? = 1/T. Therefore the total trajectory-dependent 
entropy production !S] may be written as 



drS = dry + drW - 2ip. 



(AlO) 



The corresponding integral fluctuation theorems for S, 
y, and W, particular cases of Eqs. (A4), (A5), and (A6|, 
respectively, read 



1. 



(All) 



{o[T]y 



(A4) 



The first fluctuation theorem in Eq.(All) is the well- 
known integral fluctuation theorem for the total entropy 
production or Jarzynski relation, here generalized to ar- 
bitrary initial conditions and dynamics without detailed 
balance. The second one is the Hatano-Sasa extension 
discussed in detail in Sec. |IIH and the third one can be 
considered as an extension of the Speck and Seifert in- 
tegral fluctuation theorem T5^. We note, however, that 
the interpretation of y and W as the nonadiabatic Sna 
and adiabatic Sa entropy production contributions, re- 
spectively, is lost due to the presence of ip, which does 
not vanish in the adiabatic limit if pj-ef ^ pss. 

When pref = Pss, 4>ref = 0, and (p — 0, and the three 
extended fluctuation theorems reduce to the three fluc- 
tuation relations described in Ref. [20] • In this case, the 
dual dynamics becomes exactly the standard dual or ad- 
joint (f) dynamics, and up to boundary terms we can 
identify y — Sna, W — Sa- In addition, we note that 
Eq. ( [27] ) reduces to the standard dual dynamics in its 
Langevin form by the simple replacement (/jj-ei — > 0- The 
dual dynamics given here is therefore the natural and 
probably simplest generalization of the standard dual dy- 
namics that does not rely on the knowledge of pss ■ 
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